On solutions of a class of non-Markovian Fokker-Planck equations 



(N 
O 

o 



0^ 
(N 



I 

o 
o 



(N 
> 
O 

O 
(N 
O 



o 



X 
J3 



I.M. Sokolov 

Institut fiir Physik, Humboldt-Universitdt zu Berlin, Invalidenstr. 

(Dated: February 1, 2008) 



110, D-10115 Berlin, Germany 



We show that a formal solution of a rather general non-Markovian Fokker-Planck equation can be 
represented in a form of an integral decomposition and thus can be expressed through the solution 
of the Markovian equation with the same Fokker-Planck operator. This allows us to classify memory 
kernels into safe ones, for which the solution is always a probability density, and dangerous ones, 
when this is not guaranteed. The first situation describes random processes subordinated to a 
Wiener process, while the second one typically corresponds to random processes showing a strong 
ballistic component. In this case the non-Markovian Fokker-Planck equation is only valid in a 
restricted range of parameters, initial and boundary conditions. 



PACS numbers: 05.40.-a 05.60.-k 02.50.-r 

Many physical phenomena related to relaxation 
in complex systems are described by non-Markovian 
Fokker-Planck equations in a form 

^P(x, t)^ J K{t ~ t')LP{^, t')dt\ (1) 

where K(t) is a memory kernel and where £ is a linear op- 
erator acting on variable(s) x. Such equations are often 
postulated on the basis of linear-response considerations 
for different physical situations and in several cases can 
be more or less rigorously derived based on a microscopic 
description. In the symmetric case, the usual form of the 
operator £ reads: 



£P(x,t) = D 



AP(x,t) 



(2) 



where D is the diffusion coefficient (here supposed to be 
coordinate-independent) and f{x) — — V[/(x) is a poten- 
tial force. Depending on boundary conditions, the oper- 
ator Eq.(||) may or may not possess an equilibrium state 
P(x, t) = VF(x), which corresponds to the solution of 
the equation -(fcBT)"if (x)VF(x) + VPF(x) = 0, so that 
W{x.) = exp{—UCx.) / ksT) is a Boltzmann distribution. 
In this case Eq.(Eh can be rewritten in the form 



(3) 



which is known to appear naturally when describing ther- 
modynamics of complex systems when reducing their be- 
havior to a few relevant variables (thermodynamical ob- 
servables Xa) as is done e.g. in the Zwanzig's approach 
0. Compared to the general form of Ref. Eq.(0) 
lacks the drift terrn; in some cases this general form can 
be reduced to Eq.(|^), say by a Galilean transformation, 
see |,|. 

The Eq.(|l|) with a (5-functional memory kernel K{t) = 
S{t) corresponds to a usual Fokker-Planck equation 
(FPE) describing Markovian processes. The solution 
of this equation is known to be a proper probability 
density (so that P(x,t) > and /P(x,t)dx = 1) if 



the stationary state exists (i.e. whenever the Fokker- 
Planck operator possesses a zero eigenvalue), otherwise 
it is a non-proper probability density (P(x, t) > and 
/ P(x,i)dx < 1). 

Many special forms of memory kernels are of interest. 
We note that fractional Fokker-Planck equations widely 
discussed as a relevant mathematical tool for the descrip- 
tion of many complex phenomena |^ belong just to the 
class described by Eq.(^) with K{t) being a power func- 
tion of t: K{t) (X and that the so-called distributed- 
order fractional equations, introduced on the phenomeno- 
logical basis in Rcf. Q and describing slow processes 
lacking scaling Q correspond to related kernels in a form 
K{t) (X J f{a)t~"da. On the other hand, much less ex- 
otic exponential kernels, describing the rather fast mem- 
ory decay, are ubiquitous. More complex kernels are en- 
countered when describing reactions in polymer systems 

§0. 

The subdiffusive processes described by fractional 
Fokker-Planck equations with 1 < a < 2 are known to 
be subordinated to a Wiener process |§, §), so that the 
solution of this equation can be obtained through an in- 
tegral transformation of the solution of a usual (Marko- 
vian) FPEs with the same potential, initial and boundary 
conditions. As we proceed to show, some analogue state- 
ments can be done also for the general version of the 
non-Markovian FPE. The properties of such a transform 
and some important consequences of its existence will be 
discussed in what follows. 

Let us show that the formal solution of the non- 
Markovian Fokker-Planck equation can be obtained in 
a form of an integral decomposition 



/"OO 

P(x,i) = / F{^,T)T{T,t)dT, 

Jo 



(4) 



where P(x, r) is a solution of a Markovian FPE with the 
same Fokker-Planck operator £ 



^P(x,i) =£P(x,t), 



(5) 



and for the same initial and boundary conditions, and 
the function T{t, t) is connected with the memory ker- 
nel K{t) |, |. Parallel to Ref. @ we shall call 
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T the internal variable of decomposition, and x and 
t its external variables. Moreover, we show that the 
Laplace-transform T(t, u) of T(t, t) in its external vari- 
able, f{T,u) = T{T,t)e-'^^dt reads: 



f(r,u) = ^ 



1 



K{u) 



exp 



K{u) 



(6) 



where K(u) is a Laplace-transform of the memory kernel 
K(t). Eq.(p) means that the Laplace-transform of P(x, t) 
in its temporal variable reads: 



P(x,u) = 



die 



dTF{x,T)T{T,t) 



/ dTF{x,T)f{T,u) 

Jo 

/ drFlx, t) — exp 

Jo K{u) 



K{u) 



I ~ I u 
-F x,^ 



K{u) 



K{u) 



(7) 



where i^(x, u) is a Laplace-transform of -F(x, t) in its 
second variable r. Let us now note that the Laplace- 
transform of the non-Markovian FPE, Eq.dll) reads: 



wP(x, u) - P{x, 0) = K{u)CP(^x, u), 



(8) 



where P{x, 0) is the initial condition. Inserting the form, 
Eq.(0), into Eq.(|l) one gets: 



K{u 



■F X 



' K{u) 



P(x,0) =CF{x 



K{u) 



(9) 



Introducing a new variable s ~ u/K{u) we rewrite Eq. 
in a form 



sF (x, s) - F(x, 0) (x, s) ; 



(10) 



in which one readily recognizes the Laplace-transform of 
an ordinary, Markovian FPE, Eq.(||), with the same ini- 
tial condition P(x, 0). This completes our proof. Thus, 
the solution of a non-Markovian Fokker-Planck equation 
of the type of Eq. (|l|) in the Laplace domain is connected 
with the solution of the regular Fokker-Planck equation 
through 



N 1 - / u 

P(x,?/) = ^:— F(X,- 



K{u) 



K{u) 



(11) 



In the time domain this corresponds to Eq.(^, where 
T(r, t) is given by Eq.(^. 

The existence of the formal solution of the non- 
Markovian FPE in form of Eq. ( |ll|) brings several advan- 
tages: It gives an analytical tool to express the solution of 
the non-Markovian problem through the solution of the 
Markovian one, which is often known (at least for sim- 
ple potentials and simple boundary conditions). Even 
if the solutions are not known analytically, a numerical 



procedure based on Eq. (| ) can be much simpler than 
the direct solution of Eq.(l]). Moreover, in many cases 
the non-negativity of the solution of a non-Markovian 
FPE (assumed to be a probability density) can be eas- 
ily proved without solving the equation. This is true for 
a wide class of relaxation processes subordinated to a 
Wiener process, i.e. for the equations with "safe" kernels 
{vide infra). 

Note that P(x, t) is for each x a nonnegative func- 
tion of t, since it is a (possibly, non-proper) probability 
density function (pdf) in x. A function f{u) is a Laplace- 
transform of a nonnegative function defined on [0, cx)) if 
and only if f{u) is completely monotone, i.e. /(O) > 
and (-!)"/(")(") > 0> see Chap. XIII of Ref. [0. 
Remember now, that P(x,it) = F {yi,u/k{u)^ /k{u) 

where the function F (x, s) is completely monotone in its 
second variable. This allows us to classify all kernels into 
the "safe" ones, for which P(x, u) is completely mono- 
tone for any completely monotone function F (x, u), and 
the "dangerous" ones, when this is not the case. Noting 
that the product of two completely monotone functions 
is a completely monotone function and that a function of 
the type f{g(u)) is completely monotone, if f{s) is com- 
pletely monotone and if the function g{u) is positive and 
possesses a completely monotone derivative we can 
easily formulate a sufficient condition for safety: It is the 
case if both functions, K(u) and u/K{u) are positive and 
possess completely monotone derivatives. As we proceed 
to show, in this case P(t, t) is a pdf in its first vari- 
able. The kernels for which this is the case are "safe" in 
the sense that whatever the Fokker-Planck operator C is 
(i.e. whatever the potential, the initial and the boundary 
conditions are), the solutions of the non-Markovian FPE 
will be nonnegative and physically sound. The dangerous 
kernels correspond to the situations when the physical 
solutions of the non-Markovian Fokker-Planck equations 
exist only in the restricted domain of parameters. 

The function T(r, t) is always normalized to unity 
with respect to variable r. To see this, let us consider 
J(t) — dTT{T,t). Its Laplace transform is J{u) = 

dTT{T,u) =^ K^^{u) Jg°° dr exp —tu/K{u) ~ 

so that J{t) = 1. On the other hand, T(r, t) may or may 
not be a probability distribution of r on [0, oo), depend- 
ing on whether this function is non-negative or may take 
negative values. For all safe kernels T{T,t) is a proba- 
bility distribution: T{t, u) has just the form r(T, u) — 

exp —Tu/K{u) /K{u), i.e. corresponds exactly to the 
form mentioned above where we take exp(— tu) instead 
of function F. The non-negativity of the solutions of 
the non-Markovian FPEs then immediately follows from 
the fact that the integrand in Eq. (|^) is a product of two 
non-negative functions. 

Let us now consider a few examples. 

Example 1. As a simplest example let us con- 
sider the Markovian situation, in which K{t) = 
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5{t), so that K{u) = 1. The function T{t,u) = 
K{u)~^ eyip[~Tu/K{u)] — exp[— rw], so that T{T,t) — 
5{t — t), and the decomposition, Eq.(^, is an identity 
transform. 

Example 2. An example of a safe kernel is a power-law 
kernel K{t) ~ t^" with 1 < a < 2: both its Laplace- 
transform is K{u) = r(l — a)u'^~^ and the function 



u/K{u) 



"/r(l — a) are positive and have a com- 



pletely monotone derivative. Note that such power-law 
kernels just correspond to the fractional Fokker-Planck 
equations (with the additional fractional derivative of 
the order 7 = a — 1 in their right-hand side, i.e. with 
< 7 < 1), which got now to be popular tools in de- 
scribing slow relaxation |3|. These equations are abso- 
lutely safe 1^. The same is valid for the kernels of 
the distributed-order equations, K{t) cx / f{a)t~°'da as 
long as the function f{a) vanishes outside of the interval 
(1,2), Ref. @. 

Example 3. As an example of a dangerous kernel we 
consider a simple exponentially decaying one K{t) =^ 
rexp(— rt) (the form is taken to be normalized in a way 
that for r 00 it tends to a (5- function) . The Laplace- 
transform of this kernel reads: K{u) = r/(u + r), so 
that u/K{u) = {y? -\- ruj jr. Here the first and the sec- 
ond derivative of the last function have the same positive 
sign; thus it is not completely monotone. Let us show, 
that the non-Markovian FPE with such a kernel may lead 
to negative solutions. 

This really is the case if the system's behavior in a 
constant field is considered. In what follows we restrict 
ourselves to a one-dimensional situation. The Green's 
function solution of the FPE in a constant field (initial 
condition F(a;,0) = &[x^) reads: 



F(x,t) 



2\Ari> 



: exp 



{x ~ fifrY 

4:DT 



(12) 



with /i = D/ksT, so that its Laplace-transform in its 
temporal variable is: 



F(x,s) 



exp(/^/x/2i?) 



exp(2CA) 1 
2Vd VC^n 



4L> 
exp 



s \t r 

4D 



dt = 



-2V(C2-f s)A2 (13) 



(see 2.3.16.2 of Ref . [jllll ) , where the variables A = xjly/D 
and C = m//2V^ are introduced. The function P(x,u) 
is obtained from F(x,s) by multiplying by 1/K(u) and 
by substitution s — u/K{u), so that 



P{x,u) 



exp(2CA) {u + r)/r 



2VI? y^C^ +u{u + r)/r 
X exp -2 |A| y^C^ +u{u + r)/r (14) 



This function is not completely monotone: Its first 
derivative (which has to be always negative in the 
case of a pdf) changes sign, getting (for small u, 
i.e. in the long-time asymptotic) positive for C > 
(2r)-i {\X\r^ + V>^r^T2T^) (here we took C > 0, so 
that the overall distribution moves to the right). The os- 
cillations occur initially at small |A|, corresponding to the 
initial position. Since the maximum of the pdf moves to 
the right, they occur at the left flank of the distribution, 
and for ( > (c = \AV2- Thus, if the force / is strong 
enough, / > \/2rD / ^, the solution of non-Markovian 
FPE ceases at long times to be a probability density, ex- 
cept for the Markovian case r ^ 00. On the other hand, 
for the force-free case of pure diffusion (^ = 0) we have 



P(x,u) = — exp 



2VD 



y'uiu + r) /r 



(15) 

which is a completely monotone function defining a pdf. 
For u small {t large) this function tends to a form corre- 
sponding to a Gaussian: 



P{x,u) 



1 1 



exp [-2 |A| y/u] 



(16) 



which is our Eq.(p^ with / = 0, while for large u (small 
t) we have 



P(x,M -> 0) 



corresponding to 



1 



■.exp[-2\X\u/V^ (17) 



P{x,t) 




ls{\x\ 



^t). (18) 



At early times an initial pulse propagates as a wave, 
while at later times the propagation gets diffusive, Ref. 
|l2| . Note that Dr has a dimension of velocity squared 
(so that D = jr where v is the typical velocity and 
Tc = 1/r is the correlation time). Thus, at short times 
P{x,t) — ■^SQxl —vt), and the overall equation describes 
the transition from a ballistic to a diffusive propagation, 
i.e. a kind of a Drude model. The mean-free path in the 
model is exactly vtc = \JD jr. The breakdown of the 
physical solution for larger forces gets now a clear phys- 
ical meaning: The case / > \/2rD j [i corresponds to the 
situation when the mean velocity gain on the mean free 
path is larger than the rms velocity v = \jDr, clearly the 
case in which the diffusion coefficient D can no more be 
considered as force-independent (which is only possible 
for [ij <C V where the force enters as a perturbation). 

Thus, our analysis shows that the transition to non- 
positive solutions denotes leaving the region of physical 
validity of the model: the fact that the kernel is " danger- 
ous" shows, that corresponding equations are only rea- 
sonable in a restricted domain of parameters, initial and 
boundary conditions, and that other conditions are un- 
physical. 
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FIG. 1: The time evolution of the Green's function solution 
of a non-Markovian diffusion equation (/ = 0), see text for 
details. The parameters are _D = r = 1, so that the peaks 
move with the velocity v — 1. The curves correspond to 
t — 0.5, 1, 2 and 3 (from left to right). 



The behavior of P{x, t) for the exponential kernel and 
for / = is shown in Fig.l, where the results of numeri- 
cal inversion of Eq.([l^) are shown for t = 0.5, 1, 2 and 3. 
Here only the part for a; > is shown since P{x, t) is an 
even function of x. The overall form of the distribution 
with the two side peaks is typical for systems showing 
random- walk behavior with strong ballistic component, 
like Levy walks. At difference with the Levy-walk situ- 
ation, the overall weight of the peaks decays very fast. 
Thus, for t = 0.5 they absorb more than one-half of the 
overall probability, while for i = 3 the most of the prob- 
ability lies in the central part of the distribution, whose 
form slowly tends to a Gaussian. 

Note that the situation when the short-time behav- 
ior is ballistic and corresponds to the distribution with 
pronounced side peaks (stemming essentially from the 
solution of the Liouville equation) is typical (as a short- 
time behavior) for all kernels K{t) which tend to a con- 
stant value at t ^ 0: For all of them K{u) ~ K{Q)/u 
for u large, so that Eq.(p7|) asymptotically holds. Turn- 
ing to kernels behaving at short times as a power-law, 
K{t) ~ t~°' (corresponding to K{u) ~ r(l — a)u°'~'^), we 
note that the kernels with < a < 1 lead to the simi- 
lar kind of behavior (bimodal pdf), see Ref. where 
the peaks are the less pronounced the larger is a. On the 
other hand, safe power-law kernels with 1 < a < 2 lead to 
pdf's showing a single peak at zero. It is also interesting 
to discuss the two other situations: The kernels starting 
from zero and the strongly decaying power-laws. Now, a 
situation of a kernel starting at zero, i.e. as K{t) ~ 
with /? > 0, corresponds to K{u) ~ u^^^^^ and therefore 
to 



u0/^ 

Pix, u) — — = exp 
2y/D 



-2|A| 



,l+/3/2 



derivative changes sign at m = [2 |A| (2 -I- /3)//3]^^^*-^^''^), 
and thus is not a Laplace-transform of a pdf. The same is 
the case for the kernels with stronger divergence, K{t) ~ 
i"" with a>2. Here 



P{x,u) 



-a/2 



2/D 



exp 



-2|A| 



,l-a/2 



is again not a completely monotone function: its second 
derivative Puuix, u) (which is essentially a quadratic form 
in |A|) possesses a positive root for all a > 2. Thus, the 
set of kernels which correspond to physical behavior (in a 
force-free case) consists of kernels which behave at small 
t as K{t) ~ t-" with < a < 2. AU other kernels can 
be considered as approximations which are not valid at 
short times. 

Let us make some notes about the long-time asymp- 
totic behavior. For t large all integrable kernels corre- 
spond to the behavior K{u) — > / with / = K{t)dt, 
and thus lead to 



P{x,u) 



1 



1 



2^/D Vhl 



exp 



which is not a completely monotone function (its first 



i.e. to the Gaussian behavior. All these kernels cor- 
respond essentially to the processes which can at longer 
times be approximated by a Markovian process. The ker- 
nels whose integral diverges are exemplified by the safe 
power-law-like kernels K{t) cx t~" with 1 < a < 2, where 
the divergence stems from the short-time behavior, and 
the dangerous power-laws (0 < a < 1) where the in- 
tegral diverges at infinity. Both of them correspond to 
non-decoupling memory. The situations are considered in 
detail in Refs. |, |. The growing kernels are definitely 
unphysical. 

Whenever the kernel is safe, the variable r can be inter- 
preted as an operational time, and T(r, t) is a pdf of the 
operational time r at physical time t, and our integral de- 
composition corresponds to a subordination. Whenever 
T(r, t) can be considered as pdf resulting from a ran- 
dom process with nonnegative increments, we have to do 
with a continuous-time random walk situation (CTRW) 
or its continuous limit. The corresponding solutions of 
the non-Markovian FPEs (including the Green's func- 
tion solutions) can then be represented as the solutions 
of the ordinary FPE corresponding to different final op- 
erational times; these solutions are weighted with the 
distribution of this final operational time, which is given 
by the pdf T(r, t). Thus, the ensemble of the sample 
paths corresponding to a random process described by 
the non-Markovian FPE with a safe kernel can be vi- 
sualized as an ensemble of paths (random walks) of a 
process described by a corresponding Markovian equa- 
tion, taken not at a given time t, but having different 
temporal "lengths" (duration). 

The dangerous kernels correspond to the situation 
when some of these paths enter with negative weight, 
so that the overall positiveness of the solution can not 
in general be guaranteed. We note that the case of the 
exponential kernel (for which the non-Markovian FPE 
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can be rewritten in the form of the telegrapher's equa- 
tion) can be considered as an approximation for a CTRW 
with the waiting-time distribution being a difference of 
two exponentials fl^ . However, neglecting higher terms 
in such an approximation leads to the fact that the ex- 
ponential kernel is dangerous, and that the positiveness 
of the solution is not always guaranteed. 

Let us now summarize our findings. We considered 
a formal solution of a rather general form of a non- 
Markovian Fokker-Planck equation and have shown that 
this can be represented in a form of integral decom- 
position. This allows us to classify the memory ker- 



nels into safe ones, for which the solution of the non- 
Markovian FPE is always a probability density, and dan- 
gerous ones, when this is not guaranteed. In this case the 
non-Markovian FPE is only valid in a restricted range of 
parameters, or under special initial and boundary con- 
ditions. The examples of the non-Markovian FPE with 
dangerous kernels considered render clear that such equa- 
tions describe the processes with strong ballistic compo- 
nent. 

The author is grateful to Yossi Klafter for valuable 
discussions and to the Fonds der Chemischen Industrie 
for the partial financial support. 



[1] R. Zwanzig, Phys. Rev. 124, 983 (1961) 

[2] R. Metzler, J. Klafter and I.M. Sokolov, Phys. Rev. E 

58, 1621 (1998) 
[3] R. Metzler and J. Klafter, Physics Reports 339, 1 (2000) 
[4] M. Caputo, Fractional calculus and Applied Analysis 4, 

421 (2001) 

[5] A. Chec hkin. R. Gorenflo a nd I.M. Sokolov, submitted, 

preprint cond-mat/020221J 
[6] B.J. Cherayil, J. Chem. Phys. 97, 2090 (1992); 
[7] T. Bandyopadhyay and S.K. Ghosh, J. Chem. Phys. 116, 

4366 (2002) 



[8] I.M. Sokolov, Phys. Rev. E 63, 056111 (2001) 
[9] E. Barkai, Phys. Rev. E 63, 046118 (2001) 
[10] W. Feller, An Introduction to Probability Theory and Its 

Applications, J.Willey & Sons, NY (1971) vol. I and II. 
[11] A. P. Prudnikov, Yu.A. Brychkov and O.I. Marichev, In- 
tegrals and Series (Russ.), Moscow, Nauka, 1981 
[12] V.M. Kemkre, E.W. MontroU and M.F. Shiesinger, J. 

Stat. Phys. 9, 45 (1973) 
[13] R. Metzler and J. Klafter, Europhys. Lett. 51, 492 (2000) 



